A smart segmentation technique towards improved infrequent non-speech gestural activity recognition model

نویسندگان

  • Mohammad Arif Ul Alam
  • Nirmalya Roy
  • Aryya Gangopadhyay
  • Elizabeth Galik
چکیده

Infrequent Non-Speech Gestural Activities (IGAs) such as coughing, deglutition and yawning help identify fine-grained physiological symptoms and chronic psychological conditions which are not directly observable from traditional daily activities.We propose a new wearable smart earring which is capable of differentiating IGAs in daily environment with single integrated accelerometer sensor signal processing. Our prior framework, GeSmart, shows significant improvement in IGAs recognition based on smart earring which necessitates users to replace the earring batteries frequently due to its energy hungry requirement (high sampling frequency) towards fine-grained IGAs recognition. In this improved work, we propose a new segmentation technique along with GeSmart which takes the advantages of change-point detection algorithm to segment sensor data streams, feature extraction and classification thus any machine learning technique can perform significantly well in low sampling rate. We also implement a baseline traditional graphical model based gesture recognition techniques and compare their performances with ourmodel in terms of accuracy, energy consumption and degradation of sampling rate scenarios. Experimental results based on real data traces demonstrate that our approach improves the performances significantly compared to previously proposed solutions. We also apply our segmentation technique on two benchmark datasets to prove the superiority of our technique in low sampling rate scenario. © 2016 Elsevier B.V. All rights reserved.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Computer Science and Artificial Intelligence Laboratory Gestural Cues for Sentence Segmentation

In human-human dialogues, face-to-face meetings are often preferred over phone conversations. One explanation is that non-verbal modalities such as gesture provide additional information, making communication more efficient and accurate. If so, computer processing of natural language could improve by attending to non-verbal modalities as well. We consider the problem of sentence segmentation, u...

متن کامل

Gestural Cues for Sentence Segmentation

In human-human dialogues, face-to-face meetings are often preferred over phone conversations. One explanation is that non-verbal modalities such as gesture provide additional information, making communication more efficient and accurate. If so, computer processing of natural language could improve by attending to non-verbal modalities as well. We consider the problem of sentence segmentation, u...

متن کامل

Improved Bayesian Training for Context-Dependent Modeling in Continuous Persian Speech Recognition

Context-dependent modeling is a widely used technique for better phone modeling in continuous speech recognition. While different types of context-dependent models have been used, triphones have been known as the most effective ones. In this paper, a Maximum a Posteriori (MAP) estimation approach has been used to estimate the parameters of the untied triphone model set used in data-driven clust...

متن کامل

The entropy of the articulatory phonological code: recognizing gestures from tract variables

We propose an instantaneous “gestural pattern vector” to encode the instantaneous pattern of gesture activations across tract variables in the gestural score. The design of these gestural pattern vectors is the first step towards an automatic speech recognizer motivated by articulatory phonology, which is expected to be more invariant to speech coarticulation and reduction than conventional spe...

متن کامل

Gestural Cohesion for Topic Segmentation

This paper explores the relationship between discourse segmentation and coverbal gesture. Introducing the idea of gestural cohesion, we show that coherent topic segments are characterized by homogeneous gestural forms and that changes in the distribution of gestural features predict segment boundaries. Gestural features are extracted automatically from video, and are combined with lexical featu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Pervasive and Mobile Computing

دوره 34  شماره 

صفحات  -

تاریخ انتشار 2017